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weighting matrix. These sensitivities are approximated by 
finite-difference perturbations of the weighting matrix 
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INTRODUCTION 



I . 



•The linear regulator is one of the most extensively 
studied and well known problems of optimal control theory. 



many practical control problems can be formulated in the 
linear regulator form. Its most desirable feature is that 
the optimal control law employs linear state- var iable feed- 
ba ck . 

A. THE GENERAL LINEAR REGULATOR PROBLEM 

A linear regulator problem may be formulated as follows: 
Consider a completely controllable, completely observable 
multivariable time-varying dynamic system 



where the real symmetric nxn weighting matrices Q(t) and H 
are non-negative definite, and the real symmetric mxm weighting 
matrix R(t) is positive definite. x(t) is the nxl state vector, 

t 

u(t) is the mxl vector of controls, B( t ) is an nxm matrix, A(t) 
is an nxn matrix and the final time, t^_, is fixed. The optimal 
control u (t) minimizes J, and is given by £l,2j 



Ll,2,3,4,5,6,7,8j . This importance stems from the fact that 



x(t) = A( t )x( t)+B( t)u( t) 
and the performance index 



( 1 - 1 ) 




+ u T (t)R(t)u( t) )dt, (1-2) 



u*(t) = -R _1 (t)B T (t)K(t)x(t) 3 



u*(t) £ - F*(t)x(t). 



(1-3) 
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K ( t ) is the nxn positive definite symmetric matrix solution 
to the Riccati equation 

K(t) = -A T (t)K(t)-K(t)A(t)-Q(t)+K(t)B(t)R' 1 (t)B T (t)K(t) (1-4) 

with the boundary condition 

K(t f ) = H o (1-5) 

Because the system is assumed to be controllable and 
observable, it is possible to achieve arbitrary dynamics with 
state-variable feedback [ 7 ]- The practical application of 
optimal linear regulator theory to system design leads to 
the problem of selecting the weighting matrices. The state 
trajectory of the optimal system given by the solution of 

x(t) = lA(t)-B(t)F*(t)Jx(t) (1-6) 

is dependent upon the weighting matrices chosen. It is 
therefore desirable to establish a relationship between the 
weighting matrices and the design objectives (such as percent 
overshoot, time to overshoot and settling time) with the ob- 
jective of developing a design procedure. 

B. A RESTRICTED LINEAR REGULATOR PROBLEM 

This thesis considers only the time- invar iant , single- 
input, finite final-time (t^ < « ) linear regulator problem. 

For this problem A, R, and Q are constant matrices and B is 
the constant nxl vector b. 
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C. LITERATURE SURVEY 



None of the literature surveyed proposes a systematic 
procedure for finding a suitable weighting matrix Q for the 
finite final-time problem ( t^ < 00 ) . The infinite final-time 
problem has been considered by several authors [ 5,7 3 8J. 

The most extensively used method for selecting a suitable 
weighting matrix Q is to make an educated guess, observe the 
result, and update the guess. The major fault here is that 
there is no guarantee that an acceptable Q can be found in a 
feasible number of trials. 

The most definitive procedure for finding Q in the infi- 
nite final-time problem has been developed by Chen and Shen C 7 J - 
In their procedure a weighting matrix is selected to yield a 
set of desired closed-loop eigenvalues. A direct relationship 
between an incremental change in the closed-loop eigenvalues 
and the corresponding change in the weighting matrix Q is 
established using Jacobi f s sensitivity formula and per tur bat ion 
of the steady-state solution of the Riccati equations (K = 0). 
Two iterative algorithms are given for the determination of 
the elements of the weighting matrix Q* 

This procedure would be difficult to extend to the finite 
final-time problem because a desired set of time-varying eigen- 
values would have to be formulatedo It was felt that this 
extension would not be beneficial » 
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A different approach was taken by Wakeland in his doctoral 
dissertation [8j 0 He considers the system given by 

e = A e (1-7) 

where A is an nxn matrix in phas e- var iable form C 9 J and e 

is the vector difference between the system output £ and the 

desired system output £. The performance criterion used is 

00 

J =/ e X Qedt (1-8) 

0 

where Q is an nxn diagonal matrix. Wakeland T s empirical 
results show that the elements of the weighting matrix 

Q = diag [ 1 , q 22 , , . . . , q pn J (I "9) 



are directly related to the slopes of the elements of the 
cost functional with respect to the parameters of the system 
matrix, where the cost functional is expressed as 



J 




e^dt 




2 , 

e 2 dt 




2 

e dt , 
n 



( 1 - 10 ) 



The weighting matrix elements are defined in terms of these 
slopes for second- 3 third-and fourth-order systems. Analytic 
relationships between weighting matrix elements and system 
parameters are developed, and graphs and tables that repre- 
sent these relationships for second- , third-and fourth-order 
systems are given. These graphs and tables present the re- 
lationships between weighting matrix elements and certain 
time-response performance characteristics such as overshoot 
and settling time. 
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Schultz and Melsa , [ 5~\ , consider the inf in i te- t ime problem 



( t^ = co ) where the system is assumed to be in phase- var iable 
form and show that the cost functional given by 



= 1 (x T (t)Qx(t)+ru(t) 2 



)dt 



(1-11) 



may be reduced to 

^oo 

dt+x T ( as )Sx(<»)-x T (0)Sx(0) . (1-12) 

^ ^ ^ ^ . th , th 

S is an nxn symmetric constant matrix whose n row and n 

columns are set to zero, in order to make the reduction in- 

T 

dependent of the system (A,b) , Since the term, x (O)Sx(O), 

depends only on the initial conditions, x(0), it has no 

. . . T 

effect in the minimization of J. For the term, x ( ao )Sx( QC> ), 

to have no effect, the system must be asymptotically stable. 

The reduced performance index has only n weighting factors 

to be considered which can be related to the concept of 

modeling ,L 5 J • The elements of the weighting vector, form 

the coefficients of an ( n-1 ) s t-or der differential equation 



= j f (I T 2£ 

n l 



( t ) ) 2 + r u( t ) 2 



y ± y + y 2 y + y?v + ' 



A n -1 ) 
d v 

— t~ ~ = 0 (i-i3) 






which must be satisfied by the output of the system under 
consideration to minimize J. Therefore, equation (1-13) is 
regarded as a model for which a desired response is formulated 
the model is adjusted to satisfy classical response charac- 
teristics, such as rise-time, overshoot, phase margin, and so 
forth. The adjusted coefficient vector, is the weighting 
vector for the performance index. 
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II . FORMULATION OF THE WEIGHTING -MATRIX SELECTION PROBLEM 



A. INTRODUCTION 

The basic system considered is a controllable, observable, 
multivariable, time- invar iant , single-input, linear dynamic 
system given by 

x(t) = Ax(t) + b u ( t ) o (II-l) 

The performance index to be minimized is given by 

f tf 

J = h\ (x T ( t )C££( t ) + u 2 (t))dt. ( II -2 ) 

0 

The optimal control that minimizes equation (II-2) is given 
by 

u (t) = - b T K(t)x(t). (II-3) 

K(t) is the solution to the reduced Riccati equation 

K(t) = - A T K(t)-K(t)A-Q+K(t)bb T K(t) , (II-4) 

which has the boundary condition 

K(t f ) = 0 o ( II-5) . 

B. TRANSFORMATION TO CANONICAL FORMS 

It was decided, from a computational standpoint, that the 
number of non-zero elements of the Q matrix should be small « 
For this reason, transformation of the system to two canonical 
forms was examined; the diagonal state-matrix form and the 
phase- var iable forme 
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A system that has no multiple eigenvalues may be readily 
transformed into one that has a diagonal A matrix by the 
following procedure. The system has a column-par t ioned matrix 
of eigenvectors given by 

B ' [SA-'-Jn] (II - 6) 

where each eigenvector ^ is associated with its eigenvalue 
X This matrix may be normalized to 

A 

E = 



A A A 

e e • • . e 

—1 2 — n 



(n-7) 



by normalizing the individual eigenvectors to unit magnitude. 

A 

By letting x(t) = Ez(t), the new system is given by 



i(t) = A x £( t)+b 1 u( t) , 



(II-8) 



wher e 



A _i A 

A ± = E AE 



and 

A -1 

b = E b. 



(II-9) 



( 11 - 10 ) 



The matrix A^ has the form 



A n = 



0 

0 



0 



0 0 

X 2 ° 
0 A, 



o A 



(Ii-ii) 
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With the system in this form, a diagonal Q matrix may be used 
and still have complete influence on feedback; but the elements 
of the matrix may be conjugate complex. This requires that 
all computation be done using complex arithmetic. 

Since the system under consideration is completely con- 
trollable, it can be transformed into the phase- var iable form 
with a linear non-singular transformation matrix T, by letting 
x = Tz as in Rane C 9 J . This leads to the phase-var iable system 

£ = + J2q u (11-12) 

where the system matrix has the form 



0 10 0 
0 0 10 
0 0 0 1 



0 . . 

0, . 



1 

0 



“ a i “ a 2 



0 

1 

-a 



(H-13) 



and b^ = Co0....0l]. The elements in the last row of A Q 
(a^, i = l,...,n) are the coefficients of the characteristic 
polynomial for the original system matrix A. This polynomial 
is given by 



n n-1 n-2 

s +a s +a s + . 
n n-1 



+a. 



The transformation matrix T is given by 

T = LV-h 



(ii-iM 



(n-15) 
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where the element vectors may be formed by the recursive 
r elat ions 



(11-16) 

C. DIAGONAL I ZAT I ON OF THE Q MATRIX 

Kriendler, L 4] , states and proves the following theorem. 
If a linear t ime- in var iant plant is in the phase- var iabl e 
form, then for any positive semidefinite matrix Q in the 
quadratic performance index 

J = hH (x T Qx+ u2 )dt, (n-17) 

0 



t = b 



— n-1 



At +t a 
— n — n n 



-n-2 



At +t a 
— n - 1 — n n - 1 



= A l9 +t n a 9 
—1 —2 — n 2 



there exists a unique diagonal matrix 

Q* = diagi qil ,q * 2 Cl ,n-l ’ q n 

which yields the same optimal control 



(11-18) 



u (t) = - b T K(t)x(t) 



(11-19) 



and is related to Q by the formula 
* 



wher e 
able 



q.. = q . . - 2q . . +2q . 

hi hi M i-l,i+l M x-2,i-t*2 

the alternating sum is continued until all of 

q*s are exhausted. Even though^ Q .JLs— r equir ed 



( 11 - 20 ) 

the avail- 
to be 






positive semidefinite, Q needed not be so restricted. Let 
Q be the positive definite matrix 



15 



10 



0 2 



Q = 



0 

2 



1 0 
0 1 



(H-21) 



Then 

Q = diag [l0,-3,l] (11-22) 

* 

where Q is unique. 

. * 

It should be noted from equa t ion ( 1 1 -20 ) that Q does not 
depend on the elements q^. of Q where i + j is an odd number . 
Therefore when the system is in the phase- var iable form, an 
equivalent matrix (simpler than Q) may be considered, 
where q 1 . . = q. . if i+j is even and q 1 . . =0 if is i+j odd. 

The matrix Q 1 retains the positive definiteness or semi- 
definiteness of Q. 

The optimal feedback control law, jd, defined by 

P = b T K(t), (11-23) 

t h 

is a time-varying row vector consisting of the n column 
of the Riccati solution, K, for a plant in phase-variable 
form. For the infinite-time problem, the diagonal weighting 

■¥r 

matrix Q is unique and yields the same feedback jd as that 
corresponding to the original matrix Q, where 

E = b \, = bV. (11-24) 

D. INITIAL CONDITION CONSIDERATIONS 

Designing a system for a specific initial condition does 
not necessarily produce the desired time response for other 
initial conditions . A conservative design approach is adopted 



l6 



here by assuming that worst-case initial conditions occur. 
Worst-case initial conditions are defined as those which 
maximize the minimum value of the performance index as given 
by 

J min = £ T(0 ) K(°)x( 0) . (H-25) 

J . is maximized when x(0) is colinear with the eigenvector 
associated with the largest eigenvalue of K(0),[2j. 
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Ill, PROBLEM SOLUTION 



A « SEARCH IN Q SPACE 

The most direct approach to selecting the weighting 
matrix, Q, would be to perform an exhaustive search, evalu- 
ating the state trajectory for each of several selections 
of Q. Even for a low-order system, this is a formidable 
task . 

A more reasonable approach is to make an estimate for Q, 
evaluate the state trajectory and then change Q based on the 
closeness of the state trajectory to the design objectives. 
This procedure is continued until the state trajectory is 
acceptable. As this requires a subjective decision, time- 
shared computer operation is a necessity. 



B. STATE-TRAJECTORY SENSITIVITY 



The sensitivity of the state trajectory with respect to 

Q, , can be evaluated by using the sensitivity function 

oU 

approach. This involves solving the Riccati equation 



K = - A T K-KA+Kbb T K-Q 



(III-l) 



with the boundary condition 



K(t f ) = 0 (HI-2) 

simultaneously with its associated sensitivity equation 



d / SK T riK 

dt \ dQ ) A AQ 



dK ^ <dK 

9qA ♦ bb K ♦ Kbb jg 



-|q ( III-3) 



with the boundary condition 

dK(t f ) 



dQ 



= 0 , 



( m-4) 
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Then the state equation 



x = Ax + bu 



x(0) = x 

— v i — r 



( m-5) 



must be solved simultaneously with its associated sensitivity 
function equation 



d / ^(t)\ . A . k t . d* t bK 

dt { To - ) = (A '^ K) Sq * bb “so- 



with the boundary condition 

3(X(0)) 



( HI-6) 






= 0 . 



(in-7) 



th 



For an n -order system, Equation III-5 contains n first* 

r 

order differential equations. Equation III-l contains n' 

, , n • ( n+1 1 

first-order differential equations of which w . * . 



are 



unique since Q, K, and K are symmetric matrices. Equations 
III -3 and III-6 contain and n unique 

first-order differential equations, respectively, Table I 
demonstrates the rapidity with which the computational com- 
plexity increases. 



Table I. The number of differential equations, N, 
that must be solved for a system of order 
n to evaluate the state-trajectory 
sensitivity, bx/dQ 

n N 

1 4 

2 20 

3 63 

4 J 54 

5 320 

10 1 1025 
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dx 

The state- trajectory sensitivity matrix, — , must be 

OQ 

observed over the entire trajectory to obtain a relationship 
between it, the state trajectory and a new weighting matrix. 

A subjective decision in the selection of a new Q is required 
since there does not exist a direct analytical relationship 
between the design objectives for a finite final-time problem 
and the weighting matrix Q. 



C. THE DESIGN MEASURE m 
1 . Def in it ion 

The approach that seemed most promising required the 
formulation of a vector design measure, 

m = f(Q;x*,t) . ( III-8) 



Typical examples of the elements of m are listed below 

a. Max|u(t)| 0 ^ t ^ t 

t 



b. Percent overshoot 

c. Time to maximum overshoot 

d. Time to first zero crossing 

e. Time to reach and remain within 5 percent of the 
final value 




g- 

h. 




dx( t ) dt 

b a 



where 



dx( t ) 

b a 



is the state- 



trajectory sensitivity to variation in system parameters, a^, 
and s is a symmetric positive definite matrix. 
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The elements of m are further restricted to be defined 
so that they will be positive. (It should be noted that an 
analytical expression for the partial differential of the 
elements of m with respect to the elements of Q does not 
generally exist.) 

The desired vector design measure was defined to be 

* 

m ; the vector, f, has the elements defined by 



A | * I 

f . — m ,-m . j = 1 , 2 , . . . ,1 

j 1 j j 1 



(III-9) 



where L is a positive integer. The elements of f are to be 

made acceptable by adjusting the weighting matrix Q. 

2 . Difference Approximation to the Sensitivity Matrix dm/dQ 

dm 

The sensitivity matrix, t-= can be approximated by 

oQ 

perturbing the weighting matrix elements q__ to form a finite- 

, . ^ ... . . . _ dm./dq... The 

difference approximation to the partials, — l H 

vector differential dm is given by 

dm T 



dm = 



>m 



where r-r has the form 
oQ 



3Q d 2- 



( III-10) 



dm 

dQ 



dm^ 

**11 

dm 



dq 
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dm, 

£ 

dq 

dm, 

$q~ 



11 



22 



dm 

^Ti 



(in-ii) 



d rri 



nn 



dm. 



dq dq 



nn 



dm^ 

dq 



nn 
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and dm and dQ are both column vectors, with dimensions (Lxl) 
and (mxl) respectively. Equation (III-10) is used to select 
a dQ that will reduce as many of the elements of the design- 
measure difference vector, as possible. 

3 . Computational Algorithm for Selecting Q 

The steps of the basic algorithm for finding the "best" 
weighting matrix are outlined in Flow-Chart 1, with details 
given by the following list. 

a. Transformation of the system into the phase- 
variable form, in order to use a diagonal weighting matrix Q. 

b. Selection of an initial diagonal weighting matrix. 

c. Formation of the design measure m by: 

(1) Integrating the Riccati equation 

(2) Finding the worst-case initial conditions 
x( 0 ) from K(0) . 

( 3 ) Integrating the state equations with K(t) 

and x( 0 ) . 

* 

( 4 ) Setting m = f(Q;x ,t,t ). 

d. If m is not defined or is unreasonable, a restart 
is made at step b; m is not defined if some element does not 
exist. For example, if the optimal system is overdamped, 
percent overshoot has no meaning. 

e. Formation of the design-measure sensitivity matrix 




(1) Perturbing the Q elements, q^ ^ , i=l , 2 , . . . , n . 
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(2) Integrating the n sets of ^- n - 1 ^ 

d ll ,M 22 



R iccat i 

' - \ z / 

equations , R 1 , with Q 1 = diagonal ( q , q , . . . , q . . +dq , q ) 



li 



nn ' 



for i = 1,2,. 



,n. 



(3) Integrating the n state equations using R 1 (t). 

(4) Forming the perturbed vector performance 



measures, m , i = 1,.. . . ,n. 

<3m . 



- j m!-m. 

(5) - -J 1 i = 1,2, .... ,n; j = 1,2, ,L. 

^ii 



q u 



d m 



f. Selection of a normalized dQ, using a t-~, that 

— oQ 

will improve as many of the elements m_. as possible. This 
procedure is discussed in more detail in section III c4. 

g. Selection of the magnitude, a, for dQ and 
evaluation of m* by: 

(1) Initializing OL 

(2) Setting Q = Q + OfldQ where I is the nxn 
identity matrix. 



(3) Forming the vector performance measure m 
for this value of Q by: 

(a) Integrating the Riccati equation’s 



us ing Q f . 



(b) Finding the worst-case initial con- 
ditions x ! (0) for R ! (0). 

(c) Integrating the state equation’s with 

x f ( 0) and K 1 ( t ) . 

(d) Setting m* = f ( Q * ; x 1 , t , t f ) 
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h. Formulation of subjective decisions based on 



f . = m.-m. 






— 1 —l 



i — 1 >2 , . . . ,L 



( 1 1 1 - 12 ) 



and 



— i 

T 



f . = (m-m. 



i = 1,2, ... ,L (III-13) 

(1) f ' is considered to be an improvement on f 
if any of the following conditions exists: 

f 

(a) f. ^ f. i = 1,2,... ,L 

(b) The number of values of i for which 
f! ^ f. is greater than L/-> 

(2) f ’ is considered to be acceptable at this 
step if any of the following conditions exist: 

(a) f ! * e ! for a majority of the elements 

l i 

f! where £ ! is a positive small number: i = 1,2,...,L. 

l i 

(b) OL ^ £ p ; where £p is a small pos it ive number. 
¥ 

(3) f, is considered to be acceptable for the 
design if any of the following conditions exist: 

(a) f| ^ e” for a majority of the elements 
of f T where £ V is a small positive number ( £ V < e!) and it is 
clear that no further significant improvement can be made in 
the other elements by moving locally. 

(b) OL ^ € 1 where V 1 is a small positive 

P P 

number and the inequality « £ holds. 

P P 

(4) (a) If h. (1) is true, increase OL and go 
to step g . ( 2 ) . 

(b) If h.(l) is not true, decrease OL and 

go to s tep g . ( 2 ) . 

(c) If h.(2) is true, go to step e, with 



.Q = Q f • 
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Flow-Chart 1. Basic Steps of One Iteration of Design Algorithm 
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Flow Chart 1. 



cont inued 
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i. Testing the weighting matrix found by perturbing 

t 

Q to determine if a significant reduction can be made on the 

elements of £ 1 . If a significant improvement can be made go 

to step e, with Q = Q f . 

4. Considerations for Selecting dQ 

a. Problem Formulation 

3m . 

The vectors, — , j = 1,2,...,L, are normalized 
o Q 



to the vectors w . by 

-J 



d m . 



w . = — 

— j <*Q 



(iii-i4) 



\ 



j = 1,2, .. .L. 



n 

£ 

i=l 



o m .\ 

3cT 



There exist L hyperplanes H_. defined by 

H j : = ° j = 1,2, ...,L (III-15) 

where (. , . ) denotes the inner product in n-dimens ional 

Euclidian space, E n . w is in the direction of the largest 

rate of increase of dm_. . Therefore the best &Q to select 

for a particular 9m. is colinear with f w . . The sign 

“J — J 

• l * I 

selected must be that which causes dm. to minimize f .= m.-m. 

— J J 1 J J 1 

For L ^ 1, a systematic procedure must be established to 



select a dQ that will minimize as many f_. ? s as possible. 

The unit normals, n . , j = 1,2,...,L, that result 

in a reduction of f . are given by 

J 



n . = * 

-J 



w . 


m . 


< 


* 
m . 


-J 


J 




D 


— w . 


m . 




* 
m . 


J 


J 




J 



j = 1,2, ... ,L. 



(III- 16 ) 
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Defining - ^Q, there exist L half-spaces S , where S^. 
is the set of all that satisfy the relation 



^22-j’Z^ s 0 j = 1,2, . . . ,L. 



(III-17) 



Thus the hyperplane and its normal n. define a half-space 

S. which is the set of all points that reduce f . . 

J J 

The intersection of all the S. r s, given by 



s = n s , 

5 = i J 



(III-18) 



defines the set of all points that reduce all f simultaneously, 

provided that S is not the set, cp , which contains only the 

origin. If S = cp , some of f^. r s must be allowed to increase 

so that a partial improvement can be made at this step. This 

relaxation should be made only for one iteration. 

b. General Problem Considerations 

(1) First-Order System . All normals ri , for a 

first-order system, must be of equal sign to improve all 

components locally. If this is not the case, the selection 

of dQ becomes subjective for a particular trial point. 

(2) Second-Order System. A second-order system 

is considered next with L < 2. Since all the normals, n., 

-J 

have been normalized to be unit vectors, the inner products 

Rjj = j ; i > J = 1)2 ’ 0 • - L > i ? J (III-19 ) 

indicate the nature of the sets, S. given by 

i j 

S. . = S. A s .. (III-20) 

1 J 1 J 

R.. = 1.0 implies that n. and n. are parallel, therefore 
ij F -i “J 



S. . = S. = S .. 
ij t 3 



(III-21) 



as indicated in Figure 1. 
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Figure 1. Intersection of 2 half-spaces in 
2-space. R_._. = 1. 

R. . 
fore 

as indicated in Figure 2. 



1.0 implies that n anu u 















S. . = H. = H . 
ij i J 




Figure 2. Intersection of 2 half-spaces in 

2-space . R . . = -1 . 

1J 



ther e- 
( III-22 ) 
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If R. . t + 1.0 then there exists a region, R , where both 
ij — s 

inner products and (—j , ^ ^ are greater than zero 

required to reduce the design-measure difference elements 
f^ and fj simultaneously. This is depicted in Figure 3* 



as 




Figure 3* 



Intersection of 2 half-spaces. 



R . . t + 1. 



Suppose that L = 3 for a second-order system. 
If R ^2 ? ± 1 then and are linearly independent and n^ 
can be expressed as a linear combination of n ^ and by the 
relationship 



where N is 



n 3 = Na 

the partitioned matrix given by 



N = 



n i 1 n o 

—1 i —2 



(111-23) 



(III-24) 



and a is a column vector with components a , a^. 

For example, Figures 4 thru 11 depict the 
relationships that can exist between half-spaces S^,S 2 and ^3 
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for various combinations of a^ and a^. In Figure 4> 
contains the intersection of and ; therefore may be 
dropped from consideration. 




Figure 4- Intersection relationships for a >0 , a^O. 

The same situation holds in Figures 5 and 6, where and > 
respectively, may be dropped from consideration. 




Figure 5- Intersection relationships for a >0, a <0 . 

1 ^ 
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Figure 

In Figure 7, S 
may be dropped 



Figure 



Figure 




6. Intersection relationships for a^<0 , a^O. 

= S, and in Figure 8, S = S 0 ; therefore S 0 
from consideration in both cases. 




7. Intersection relationships for a =1 , a =0 . 

X ^ 




8. Intersection relationships for a^=0, a 2 =l. 
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In Figures 9 , 10 and 11, = 0; therefore at least 

one S. must be dropped from consideration to have a non-zero 

dQ. 




Figure 9 . 



Intersection relationships for a^=-l.» a 2 







Figure 10. Intersection relationships for a^=0., 
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Figure 11. Intersection relationships for a^<0, a^<0. 
S ± f) S 2 ^ S 3 = o. 



The general 
Table II. 


results 


related to these figures are tabulated in 


Figure 




a 2 


Relationship 


Dr op Fr om 
Cons iderat ion 


4 


>0 


>0 


s 2 


S 3 


5 


>0 


<0 


s l2 _s 2 ns 3 


S 1 


6 


<0 


>0 




S 2 


7 


>0 


=0 


s 3 =S 1 


S 3 


8 


=0 


>0 


S 2 =s 3 


S 3 


9 


<0 


=0 


S i r, S 3=H l =H 3 ;S 1 Os 2 ^ S 3=<p 


S 1 ° r S 3 


10 


=0 


<0 


s i ns 2 rts 3 * v;s 2 /1s 3 =h 2 =h 3 


s 2 or s 3 


11 


<0 


<0 


s i° s 2 ns 3 = <P 


or S 2 or S 



Table II. General relationships for sets S ^ , 
j = 1,2,3 for a second-order system 
when /n^nA J- + 1. 
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As an example, if Table II has indicated 



that should be dropped from consideration, the normals 

may be used to form a vector, dig*, that lies in the 

region given by the angle in Figures 12 and 13- dQ * 

is defined by r 1 

dQ 1 = U 1 £ 2 J £ (HI-25) 

where c is a column vector with components c ,c . If c and 

1 ^ -L 

c^ are restricted to be positive, then dg* lies in the region 
r| which is contained by R^ if ^ n i’ n 2 ^^ 0, as in Figure 12. 
R| contains R^ if ^n^,n^ < 0, as in Figure 13* For ^dQ* to 
lie within the region R^, the angles 9^ , and 9^ must both be 



less than or equal to 90 degrees. Let 

aL f 

dQ = 



dQ 1 



^(dQ’) 2 +(dQ^) 



2 — » * 



(III-26) 



Then the restrictions on 9^ and 9^ become 




(HI-27) 



Figure 12. Region relationships for ^n ^ ^ 0* 
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Figure 13 . Region relationships for ’2.2^ < 

The procedure discussed above considers only 
three normals, n , j =1,2,3, at a time, but can be extended 
to the case where L > 3 in an iterative fashion. At each 
iteration, one n_. is dropped from consideration using Table (II). 

This process is continued until all n. f s have been considered. 

-J 

(3) Third-Order Systems . For a third-order system, 
similar reasoning is used to develop a basis of three linearly 
independent J2j ,s# A fourth normal n^ can be represented by 

-4 = a i-l + a 2-2 + a 3-3 (III-28) 

=[”! J — 2 !H 3 ] 2. (III-29) 

= Na (III-30) 
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3 

If all a. s 0, then S f) S. and S, can be dropped from 
3 3=1 3 4 

consideration. If all a . < 0 , D S . = cp and one of the 

J j=l J 



four 


S .'s 

3 


must be dropped from consideration. Table III 


gives the 


app 


r opr iate r elat ions hips 


for n = 3>L = 4) where 


any 


3 of 


the 


normals n. are linearly 

-J 


independent. 


"l 


a 2 


a 3 


Relationship 


Drop From Consideration 


£0 


£0 


£0 


s=> s.^is.ns, 
f 1 2 3 


s 4 


<0 


<0 


<0 


4 

r\ s, = 9 

3 = 1 3 


S.. or S„ or S„ or S, 

1234 


=0 


>0 


<0 


s„o s. n s„ ns, 

2 — 13 4 


S 2 


=0 


<0 


<0 


4 

n s . = cp 

3=1 3 


S„ or S_ or S, 

2 3 4 


>0 


<0 


<0 


s 1 3.s 2 ns 3 n S/t 


S 1 


>0 


> 0 


<0 


s i n S 2 n s 3 is 





intersected by 
in such a way as 4 
to form a fourth 
bounding hyperplane . 



Table III. General relationships for sets S., 
j = 1 , . . ,4 for a third-order system 
when ri , and n are linearly 
independent . 



The relationships that exist for a^ > 0, 

> 0 and a^ < 0 in Table III imply that many boundary 
hyperplanes could exist for systems of order higher than 
two when the number of hyperplanes , L, is greater than the 
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order of the system under consideration. Results from linear 
algebra LlOj can be used to show that there may be L-(n+l) 
bounding hyperplanes and therefore L-(n+l) normals to con- 
sider. For this reason, the algebraic development was not 
pursued further for cases where L ^ n + 1. 

The set of hyperplanes not excluded from 
consideration form a convex polyhedral cone in n-dimens ional 
Euclidean space. Unit vectors, u ^ , defined as being colinear 
with the extreme edges of this cone, when summed with positive 
weighting, form an interior vector of the cone. These unit 
vectors, u_ , can be found using linear programming techni- 
ques L li J . 



The problem may be reformulated into the 

Simplex format as follows. The linear function 

n 



z = ? . y i (in-31) 

1=1 1 

is to be maximized subject to the constraints 

0 J = 1,2,.. .,L (111-32) 

|y.| < « i = 1,2, . . . , n (III-33) 

n 



E y. £ B (111-34) 

i=l 1 

where B is a positive number . If Z can be maximized by the 
Simplex routine, Z will be equal to B, and there may be more 
than one solution, y.. If there is no solution, one of the con- 

-j 

straints in equation (111-32) must be relaxed. If there are multiple 
solutions, each solution, y_ . , forms a vector which is colinear 
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with an extreme edge of the polyhedral cone formed by the set 

L 

S = n S. ( 111-35) 

( See Figure 14* ) 




Figure l4- Intersection ot 3 hyperplanes in 3“ s P a ce. 

The Simplex approach requires from one to 
L - n applications of the Simplex routine. It was felt that 
the computation required was too complex and time-consuming 
to allow the overall algorithm to be a feasible design tool. 

If L is restricted to be less than or equal 
to n + 1 , the algebraic procedures considered previously may 
be applied to find the normals of the boundary hyperplanes. 
For ease of computation and to make the algorithm feasible, 

L was further restricted to be less than four. 
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Problem Considerations for L ^ n + 1 



c . 



If the partitioned matrix 

N = 



(111-36) 



is considered, the rank of N, r(N), gives the number of 

independent normals. If r(N) = L then all normals are 

\ 

independent. The vector dQ r given by 



dQ = Nc 



will be interior to the set 



s = n s 

3=1 J 



( III-37) 



(111-38) 



if the elements of c_ are non- nega t ive . If r(N) < L 
L-r(N) half-spaces S , associated with the linearly 
normals removed from N (for this step only) to give 
duced matrix N 1 . Then dQ ? is given by 



then the 
dependent 
the re- 



dQ 1 = N*£ 

where £ is now an (r(N)xl) row vector with positive 
elements . 



(HI-39) 
equa 1 



Table II gives the general relationships that 
t h 

exist for an n -order system when L = 3 and r(N) = 2. 

t h 

Similar relationships are given in Table IV for an n -order 

system with L = 3 an( 3 r ( N ) = 1- Table V gives the relationships 

t h 

that exist for an n -order system with L = 2 and r(N) = 1. 
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Table IV. General relationships for sets S., S. 

and where n = 2, L = 3 and r(N) = 1 

n, = a n . • n . = a n . 

— k l—i — j 2—1 



a l 


a 2 


Relationship 




Dr op Fr om 


Cons idera tion 


>0 


>0 


s. = S . = S. 
1 j k 




none 








>0 


<0 


s.^s.ris, = 

1 j k 


H. . , 
1 , j 


S . , or 
3 


s. 

1 


and 


s k 


<0 


> 0 


S.^S.AS. = 
1 j k 


H. . . 


V “ 


s. 

1 


and 


s . 
3 


<0 


<0 


s.ns.ns, = 

1 j k 


H. . , 
1 , 3 ,k 


S. , or 
1 


s . 

J 


and 


s k 



Table V. General relationships for sets S. and S. 

1 J 

where n ^ 2. L = 2. r(N) = 1. n. = an. 

x 1 — j —1 



a 


Rela t ionship 


Drop From Consideration 


>0 


S. = S. 


none 




1 J 




<0 


S.riS. = H. or H . 


S . or S . 




1 3 1 3 


1 3 



The vector dQ* found by Equations 111-37 or 
111-39, when normalized to unit length gives the dQ required 
in step f. of the algorithm for selecting a new weighting 
matrix Q. 
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IV. EXAMPLES 



A. A SECOND-ORDER EXAMPLE 



The second-order system selected for consideration is 
given in phas e-var iabl e form by 



x(t) = 



0.0 1.0 
- 20 . - 5.0 



x(t) + 



u( t) . 



(IV-1) 



The final time, , was arbitrarily set at 2.5 seconds. The 
design measure, m, selected for examination, had the following 
elements : 

m^ - percent overshoot for x^(t) 

m^ - time to maximum overshoot for x_^(t) 

m^ - max |u(t)| , 0 ^ t ^ t ^ 



which had the desired values 



* 



m 



5-0 % 

0.925 seconds 

0 .0 



Percent overshoot is defined by 

overshoot of x^(t) 



m i = 



x^O) 



xlOO . 



( IV-2 ) 



(IV-3) 



1 . Estimation Procedure 

The first method used to select a suitable weighting 
matrix Q was to guess an initial Q, solve for the design 
measure m and then make a new estimate for Q based on m. This, 
of necessity, was accomplished on-line with the IBM 36 O -67 
computer in a time-sharing mode. 



42 



The estimation procedure used is given in the 
following steps. 

a . Guessing Q 1 

b. Evaluating m 

c. Repeating steps a. and b. until one element of 

* 



m, m.. was close to m.. 

~ J J 

i +1 * 

d. Selecting Q so that m. remained close to m. 

J J 

and improvement was made on one of the other elements of m. 
This was accomplished by 

(1) Perturbing Q 1 

(2) Evaluating m 1 

(3) Repeating steps (1) and (2) until a direction 

of change was established that improved one of the other 

* 

elements of m while keeping m^ close to m^. 

(4) Changing Q 1 as far as possible in the 
direction determined above. 

e. Step d. was repeated until all of the elements of 

m were as close as possible to their associated elements in 
■* 



m . This procedure changes Q along a contour of itk in the 

q n ' q 22 plane * 

Using this procedure led to the weighting matrix 
Q = diag [85.6, 13.61, with a computation time estimated at 
25 minutes. 

2 . Exhaustive Search 

The exhaustive search for the second-order example 



was arbitrarily restricted to the region R defined by 



0 ^ 



d ll 



100 . 



0 * q 22 * 20 - 



(iv-4) 



43 



R was divided into grid points with intervals of dq 11 =2.0 
and dq 22 = 0 . 25 ; dq^ was 1 squired to be this small by the 
low sensitivity of m and m with respect to q . This 
low sensitivity can be seen in Figures 15 and l6 . Approxi- 
mately 100 minutes of IBM 360-70 computation time was re- 
quired to complete the evaluation of m at all grid points. 

Figures 15? l6 and 17? obtained from this search, 

give contours for selected values of m , m and m . Figure l8 

i ^ 5 

is a composite of these figures. Graphical construction 
indicates that the desired weighting matrices is in a neigh- 
borhood of Q = diag L8l.0, 12.8J. 

3 . Application of Design Algorithm to Select Q 

The algorithm given in Chapter III was applied with 
all three elements of m being considered in the selection 
procedure for dQ, for three initial Q r s. Two initial Q*s 
were selected to test the algorithm with only m^ and m^ being 
considered in the selection procedure for dQ. The results of 
these, trials are given in Table VI. 

Attempts were made to test the algorithm with only 
m and m or m and m being considered in the selection 

-L £ £ 3 

procedure for dQ e The moves made by the algorithm did not 
tend to improve the element not being considered, or approach 
a best Q for all three elements of m. This is partially due 
to the insensitivity of m^ ? with respect to Q. This insensi- 
tivity was exaggerated by the non-con tinuous nature of time 
in the digital computer calculations. 
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Figure 15. Plane showing contours for selected 

values of percent overshoot of x r 



1.50 
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maximun overshoot of 




(N 
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Figure 17. Q. , ~Q 09 Plane shewing contours for selected values 




oco^o^rcMOooko^rcM 

CM rH i — I pH i — I rH 

CM 
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Figure 18 . Composite of Figures 15,16,17. 



Figures 19, 20 and 21 show the initial iteration 

moves made by the algorithm for trials 1, 2 and 4 in the 

q 11 -q 2 2 pl a ne . For the initial points tested, the largest 

number of iterations required to move Q 1 (the superscript 

i refers to the latest iteration number) to close proximity 

to the best Q was eight, (No claim as to the uniqueness of 

a best Q is made for this algorithm as this depends on the 
... 0 

system, initial Q , and design measure being considered.) 

From the point, Q X , which is in close proximity to the best 
Q, at least 20 and not more than 30 iterations were necessary 
to arrive at a locally unimprovable weighting matrix, denoted 
by . The Q^*s thus found were not equal, although all de- 
sign measure elements were considered to be satisfactory. 

The largest variation being in q , to which all elements of 
m are relatively insensitive in this region. 



Table VI. Results for Second-Order Example 



L 


m . f s 


Initial 




Final 




Final 








cins ider ed 


Q 




Q 




m 








to select 


















dQ 


1,1 


2,2 


1,1 


2,2 


1 


2 


3 


3 


m^ 


10.0 


1.0 


81.37 


12.897 


lOi 

O 

O 

* 

in 


0.925 


2.075 


3 


, ^2 * ^3 


1 .0 


10. c 


83.46 


12.864 


5.016 


0.925 


2.062 


3 


m^ , ^2 * ^ 3 


100.0 


1 .0 


80.44 


12.683 


5.08 


0.925 


2.044 


2 


^1 5 m 3 


10.0 


1 .0 


79.81 


12.916 


5.0001 


0.925 


2.076 


2 


5 


100.0 


1.0 


8 l. 4 l 


12.914 


4.9999 


0.925 


2.0226 
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Figure 19. Algorithm moves for trials 1(*)/ 2(+), and 4(0) on overshoot 
contour plot (initial moves only) . 
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Figure 20. Algorithm moves for trials 1(0, 2(+), and 4(0) 
overshoot regions (initial moves only) . 



3.0 



o 




(N 
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Figure 21. Algorithm moves for trials 1(‘), 2 (+) , and 4(0) 
max|u(t) | contours (initial moves only). 



B. A THIRD-ORDER EXAMPLE 



The third-order system considered was taken from L 4 l. 

It is for the linearized incremental longitudiual motion of 
an aircraft.. The system is given by 



x(t) 



-0.0016 


1.0 


- .0002 


-0.1569 


-0.0015 


- .1131 


0.0 


0.0 


- . 666 


r I 






0.0 
0.0 
0 .666 


u(t) . 





( iv- 5) 



The final-time, t^, was arbitrarily set at 2.5 seconds. The 
design measure, m, selected for examination, had the following 



elements t 

m^ - percent overshoot for x^(t) 

m^ - time to maximum overshoot for x^(t) 

m - max j u( t) | , 0 ^ t ^ t 
J t 



which were assigned the desired value 



* 

m 



4.5 % 

0.91 sec 

0.0 



( IV-6 ) 



The system was 
the manner of [ 5 j « 



transformed to the phase- var iable form in 
The transformation matrix 



T 



- 41.329 - 0.08026 

- 3.41561 -41.329 
52.809 1.406 



1.536 X 10 

6.71141 



( iv-7) 



results in a system matrix given by 



A 



0 



0 . 

0 . 

-53. 



1 . 0. 

0 . 1 . 

- 8.88 - 6.8 



( IV- 8 ) 
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Therefore the system is given by 



i(t) = A 0 z(t) 



0 

0 

1 



u(t) 



(IV-9) 



The design measure, m, is defined with respect to the 
original states. Since it was desired to observe the state 
trajectories for both the phase- var iable form and for the 
original states, the computer program was written to trans- 
form the phase state z( t) to x(t) at each integration step, 
in order to evaluate m„ A more direct method is to trans- 
form the diagonal weighting matrix to the general form, 
and perform all integration in the original state form, 
is given by 

Q = (T _1 ) T Q(T _1 ) . (IV- 10) 

9 

Kriendler®s [ 4 ] selection for the original system 

weighting matrix is Q = diag [lO.O, 0.5, 0.0], This Q 

9 9 

led to the design measure 



m 



4o497 

1.1 

97.2 



(IV-11) 



No attempt was made to guess the best Q, or to use the 
exhaustive search method, as it was felt the expected results 
would not have been worth the time or effort involved. 

The algorithm given in Chapter III was applied to the 
third-order example, with one, two and three design-measure 
elements, m , being considered in the selection procedure for 
dQ . The results of this application, with test points, are 
tabulated for all trials in Table VII. 
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Favorable results on any one trial depended on the initial 

weighting matrix, , selected and on the elements m_. , being 

considered. The first trials (1-8 in Table VII) were made 

considering either all three elements, m . , or elements rn 

J 1 

f * 

and m . Most initial points resulted in an m close to m , 

^ XX 

f * f 

but m could not be reduced to m ; m was at an apparent 

local minimum in Q space. Those trials that considered all 

design measure elements in the selection of dQ tended to 

reduce m^ more rapidly in the local region. 

Since m^ seemed to be least changeable for these first 

0 . f 

trials, a starting Q was selected that had resulted in m^ 

* 

close to m . A trial (9) was then made considering only m^ 
for selecting ^dQ. The result was a significant reduction in 

did not increase unreasonably. Sub- 
sequent trials alternated between considering m^ and con- 
sidering both m^ and m^ in the selection procedure for dQ , 



1 *1 




* 


m -rtu 


while 


rn -in 


1 2 2 I 


1 1 



1 * 




* 


m^-m^ 


and 


m 2~ m 2 



to an acceptable level. The Q thus found was used as the 
initial in a trial ( 14 ) where all three elements m_. , were 
considered in the selection procedure for dQ. This trial ( l4 ) 



significantly reduced both 



* I 




* 


m., -nr I 


and 


m -nu 


1 1 


2 2 



in two 



iterations. Tests in the neighborhood of the Q found in 
trial ( 14) showed that the element, was ZGro for this 



s y s t em . 
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TABLE V I I 



. RESULTS OF TFSTING ALGORITHM ON A THIRD- 
ORDER EXAMPLE 



TP I AL 


ACTIVE 


0: INITIAL 


I 


0(1,1) 


MU ) 


NC. 


CONSTRAINTS 


F:F INAL 










ELEMENTS 


TlTEST 








1 


1,2 


0 


1 


17000. 000 


4. 6 








c . 


P 50 . DC 


1.1 








3 


1. OF-9 


95.8 






F 


1 


1720C. 00 


4.56 










855.80 


1.1 








5 


1. OE-9 


96.17 


? 


1,2 


0 




1232.0 


5. 55 








2 


649.0 


1.48 








3 


1 . OE-9 


32. 46 






F 


1 


1 1526. 0 


4. 50 










912.5 . 


1.175 








3 


1. OF-9 


73. 89 


3 


1,2,3 


0 


1 


1 1 530.0 


4. 5 








812. 5 


1.175 








5 


1 • OE-9 


73. 89 






F 


1 


11524.2 


4.511 








2 


811.2 


1.175 








3 


1. OE-9 


73. 884 


u 


1 ,2 


0 


1 


17090.0 


.4. 5584 








2 


855.0 


1.1 








3 


1 • OE-9 


95. U6 






F 


1 


17439.83 


4.4965 








2 


846 . 6843 


1. 1 








3 


l.OE-9 


97.231 






T 


1 


174Q0.0 


4.4968 








? 


8 66. 7 


1. 1 








3 


l.OE-9 


°7.231 


c 


1,2,3 


0 


1 


17439. 3 


4. 497 








•> 


866. 68 


1. 1 








3 


1 • of-9 


97. 231 






F 


1 


17490. 21 


4. 5021 








9 


865. 9717 


1.1 








3 


1. OF-9 


97.231 


6 


1,2 


0 


1 


10000. 0 


16. 717 








2 


1 .0 


1.05 








"> 


0.00C1 


65. 6 






F 


1 


10034.0 0 


9. 53 








2 


536.23 


1.0125 








3 


- 28.93 


65. 45 






0 


1 


10031.27 


6. 78 








n 


585.9265 


1.15 








3 


0.01 
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F 


1 


10049.01 
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2 
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3 
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3 
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2 
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3 
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67. 596 






F 


i 

A. 
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c 
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0.01 
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F 


i 


10057.14 


4,5021 








2 


802. 4175 


1.2 








3 


-1.65517 


67. 338 


7 
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1 
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£_ 


802.4175 


1. 2 
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-1.65517 
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1 


10057. 13 
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2 


802. 783 
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3 


-0.72456 
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0 
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10500.00 


4.5053 








9 


802. 00 
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3 


1.0E-8 
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TABL F V I I . CONTINUED 
TRIAL ACTIVE 0: 1 NI T I AL 

NO. CONSTRAINT FiFINAL 

FLEMFNTS T : TF ST 

F 

8 It? 0 

F 

6 2 0 

F 

1C 1,2 0 

F 

112 0 

F 

12 1,2 n 

F,0 

F 

13 2 0 

F 

0 

F 

1 A 1,2,3 0 

F 

T , 0 
F 

T,n 

F 



I 0(1,1) 



1 10523.35 

2 83 .5637 

3 l.OF-8 
1 20000.00 

2 1000.00 
3 1.0F-7 

1 20007.16 

2 836.54 

3 l.OF-7 
1 20000.00 

2 836.0 

3 l.OE-7 

1 46490.00 

2 836.0 

3 l.OF-7 

1 46490.0 

2 836.0 

3 l.OF-P 

1 46493.05 

2 1039. 55 

3 l.OF-8 

1 46493 . 05 

2 10 89. 55 

3 l.OE-7 

1 47493.05 

2 91^.547 

3 1.0F-7 

1 47493.05 

2 914. 547 

3 1.0F-7 

1 47242.65 

2 1033.722 

3 l.OE-7 

1 46246. 18 

2 1033.933 

3 l.OE-7 

1 46246.18 

2 1033.933 

3 l.OE-7 

1 50000.00 

2 1083.933 

3 l.OF-7 

1 50C00.0C 

2 1083. 933 

3 0.01 

1 51000. CC 

2 1083. 933 

3 0.01 

1 51000. OC 

2 1033. 933 

3 0.01 

1 51001. OC 

2 1116.933 

3 0.01 

1 51001.00 

2 1116.933 

3 l.OF-7 

1 51000.85 

2 1116.74 

3 l.OE-7 

1 51000. 85 

? 1116.74 

3 C.001 

1 51C00.85 

2 1116.75 

3 -0.0997 



M ( I ) 



4.1638 
1.2 
69.56 
3. 7668 
1.0875 
106.12 
4. 5082 
1.075 
106. CO 
4. 5115 
0.9 

105.98 

5.4 

0.9 

178.14 

5.4 

0.9 

178. 14 

4.4895 
0. 925 

178.33 

4.4895 
0.925 

1 7 8 . 3 3 
5.2906 
0 . 6 

180.45 
5.2 606 
0. 9 

180.45 
4. 5338 
0.9125 
1 BO. 03 
4. 5065 
0.625 
177. 76 
4. 5065 
0.925 
177.76 
^.6105 
0.Q125 
186.19 
4.6103 
0.9125 
186.19 
4.6371 
0.9 

138. 33 
4.6371 
0. 9 

138. 33 
4.5005 
0. 9125 
188.42 
4.5007 
0. 9125 
188.4? 

4. 5015 
0. 9125 
188.41 
4. 5015 
0.9125 
188.41 
4. 5033 
0. 9125 
188.41 
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3 


0.0 


133.41 






T 




51000.0 


4. 5011 








2 


1 1 16.33 


0.9125 








3 
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0.0 


188. 41 
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0.9125 
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The best Q found, using the algorithm, transforms to the 



or iginal 



Q 



9 



system form, Q^, given by 

29.87207 -0.112076 

-0.112076 6.54338 

s 

-1-393 x 10* 2.705 X 10 



-1.39 x 10 



2.705 x 10 

6.497 x 10 



-14 



( IV-12 ) 



which is positive definite. 



C. DEMONSTRATION EXAMPLE 

A second-order example, that had not been considered 
previously, was selected for a comparison of the tr ial-and- 
error estimation procedure and the design algorithm. This 
system is given by 

*(t) + f°;°J u(t). ( iv-13) 

The final-time was arbitrarily set at 2.5 seconds. The design 
measure, m, considered had the following elements: 
m^ - percent overshoot for x^(t) 
m^ - time to maximum overshoot for x^(t) 
m - max |u(t)J 0 ^ t ^ t , 

3 + f 



*( t) = 



0 .0 

- 1.0 



1 .0 
- 1.0 



which had the desired value 



* 

m = 



5.0 % 

0.925 sec 

0.0 



(IV-14) 



The estimation procedure was applied for several startin 

* * 



points, with no success in satisfying both m^ and m 9 . 

Q = diag [500.0, 0.0] was the most satisfactory point found; 
the design measure for this Q was m^ = [ 4 . 629 ? .9 25? 21.971 • 
CPU time was seven minutes . 



9 
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The design algorithm was applied for an initial 

Q = diag [lOO.O, O.l], with only and being considered 

in the selection of dQ. After five iterations, an unimprovable 

weighting matrix, Q = diag [ 1 OO. 56 , 0.11539], was obtained, 

X 

which had the design measure, m = [5*026, 1.4, 9*59]* With 
only m^ and m^ being considered in the selection of dQ, an 
initial Q = diag [ 500 . , O.l] resulted in Q = diag [499*9998, 
-I.I25J and m T = [5.0022, 0.925, 21.9 66] in one iteration. 
Considering all three elements of m in the selection of dQ , 
an initial Q = diag [ 500 . , -1.1251 resulted in Q = diag [499*5, 
-I.H969] and m T = [ 5 .OOO 8 , 0.925, 21.9551 in six iterations. 
Five minutes of CPU time were required to perform these cal- 
culations . 

Application of the algorithm, considering one, two or. 
three elements of m in the selection of dQ, for the initial 
point Q = diag [ 1000 . , O.lJ, failed to result in a satisfactory 
design measure. All moves stayed in close proximity to the 
initial point. This failure was apparently due to the relative 
insensitivity of the time to overshoot with respect to Q, 
which was exaggerated by the discrete time intervals used in 
the calculations. Fourteen iterations were performed in 4*6 
minutes CPU time. 
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V. SUMMARY AND CONCLUSION 



Since the optimal state trajectory for a linear regulator 
system depends upon the weighting matrices chosen, it is de- 
sirable to establish a relationship between the weighting 
matrix, Q, and the design objectives. 

Many authors have considered methods for selecting a 
weighting matrix for the inf inite-final- time (t^ = 00 ) problem 
that result in a system that meets their requirements. The 
only methods surveyed that can be applied to the finite- 
final-time problem ( t^ < 00 ) are exhaustive search in Q space 
and tr ial-and-er r or adjustment of the Q matrix. 

The exhaustive-search method appears to be a feasible 
method for selecing Q under very restrictive conditions. The 
region that is investigated must be small or computation time 
borders on the ridiculous. This method is only feasible for 
systems where only two elements of the weighting matrix, Q, 
are allowed to vary. 

The estimation procedure does not require as many calcu- 
lations as the exhaustive method does for the same system, 
provided the subjective decisions are made properly and with 
efficient use of the computer. The procedure could be applied 
in situations where more than two elements of the weighting 
matrix are allowed to vary, but the information that must be 
processed by the designer becomes excessive. 
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It has been shown that the sensitivity of the optimal 
state trajectory with respect to the weighting matrix can be 
evaluated using the influence function approach. Because 
this evaluation is computationally complex, and it is necessary 
to consider the time-varying trajectory sensitivity to select 
a change for the t ime- invar iant weighting matrix, it was 
decided that this approach would not be fruitful. 

The procedure selected for development required the 

formulation of a vector design measure, m. This design 

measure was composed of generally used time-domain system 

characteristics such as percent overshoot, time to maximum 

overshoot, etc., and desired values were selected for each 

element of m. The purpose in selecting Q, therefore became 

the minimization of the absolute difference between each 

* 

element of m and its desired value m ^ . This difference is 
denoted by 



f . = 
J 




(V-l) 



The sensitivity of the design measure, 
must be approximated by f ini te- diff er ences 
to the finite differential dQ by 

$m T 

dm = dQ. 



'dm 

denoted by ^-r, 
OQ 



$m 

dQ 



is 



related 



(V-2) 



This relationship was utilized to develop a procedure for 
selecting a clQ that results in the reduction of as many of 
the elements, f ., as possible. 
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The procedure for selecting dQ was incorporated in an 



iterative algorithm that attempts to select a weighting 
matrix Q that minimizes each design-measure difference, f _. . 

The algorithm was tested on three examples, twb second- 
order systemsand one third-order system. These tests were 
carried out on the IEM 36 O -67 computer system operating in 
a time-sharing mode. Operation in this mode was mandatory 
due to the subjective decisions that are required by the 
procedure for selecting dQ . 

Computer CPU time for the third-order example was approxi- 
mately 91-3 minutes. It should be noted that this time in- 
cludes many calculations that were made solely to check out 
the algorithm. A designer who was reasonably familiar with 
this algorithm should require no more than one- third that 
time to develop an acceptable design for a third-order 
system. 

The tests indicate that the procedure for selecting dQ 

is a valid extension of Equation (V-2), and does lead to a 

reduction in the elements f in a neighborhood of the Q in 

question. The test further indicates that the algorithm does 

lead to a minimization of the elements f for a third-order 

J 

system, if the number of elements, m^ , used in the selection 
procedure for dQ is alternated in a judicious manner between 
one, two and three. Consideration must be given to the 



i = 1, 2,...,n, j = 1,2, ...,L, and to the current values 
of m so that needless and useless computation is avoided. 
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The algorithm developed in Chapter III, modified by the 
consideration discussed above, appears to be a feasible pro- 
cedure for use in designing optimal controls for first-, 
second-, and third-order linear regulations. An extension 
of the algorithm to linear tracking systems can be readily 
ma de . 

The extension of the algorithm to higher-order systems 

should be limited in feasibility only by the computer time 

required to integrate large-order systems of differential- 

equations. The selection procedure for dQ developed in 

th 

Chapter III applies for n -order systems, provided that 
the number of design measure elements is less than or equal 
to n+1 . This presupposes that the L hyper surf aces in n- 

*X- 

dimensional Q-space, corresponding to the elements of m , 
have a common intersection. 

It is felt that further testing of the algorithm should 
be undertaken before incorporation in a general design pro- 
cedure. This testing should include higher-order systems and 
different combinations of design measures. 

A possible direction for future research concerns a time- 
varying weighting matrix, Q( t ) . A less time-consuming inte- 
gration scheme, such as on a hybrid analog-digital computer, 

could make the evaluation of the state- tr a ject or y sensitivity, 
dx 



— , feasible for higher-order systems. It seems reasonable to 
o Q 



dx 



O X 

assume — could be used to adjust the weighting matrix, Q(t), 
to reduce the absolute difference between the elements of the 
state vector and those of a desired state vector. 
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